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IMAGE PROCESSING METHOD 



BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an image 
processing method and an image processing apparatus used 
5 with a printer, a scanner, a duplicator, a facsimile, 

etc. for reproducing the multivalued image information as 
a binary image. 

Description of the Related Art 

The error spreading method is widely known as 
10 one of the methods for converting a multivalued image 
into a binary image. 

Fig. 5 is a block diagram showing a 
conventional circuit for executing the error spreading 
method. 

15 in Fig. 5, the multivalued data D of an 

intended pixel to be binarized is read from an image 
memory 100, and subjected to 7 correction into the 
multivalued data corresponding to the printing 
characteristics of an output device such as a printer 

20 with reference to the correction data stored in a 7 
correction ROM 101. The error data E of the intended 
pixel is added to the multivalued data D 1 subjected to 7 
correction by an adder 102 of an error spread processing 
unit 107, so that F = D' + E is output. 



The data F of the intended pixel to which the 
error data has been added is compared with a binary 
threshold value Th in a comparator 104, and in the case 
where F ^ Th, a binary signal B - "l" is output, while 
in the case where F < Th, a binary signal B = "0" is 
output. From this output result, the binarization error 
E 1 is calculated as E ' = F - B f by a subtractor 106. 

In the case where the input data has 256 tones 
(0 to 255), B 1 = B x 255. In the case where the input 
multivalued data D is 230 and the binarization threshold 
value Th is 128, for example, the output data after 
binarization is B = 1, so that the binarization error E' 
is given as E 1 = D - B x 255 = 230 - 1 x 255 = -25. 

This binarization error E is stored in an error 
memory 103 in order to distribute it among the data of 
the pixels subsequently processed in accordance with a 
predetermined error matrix Mxy in a weighted error 
calculator 105, and added to the multivalued data of the 
next pixel by an adder 102, thereby transmitting the 
error data. 

Specifically, in the case under consideration 
involving the input multivalued data D of 230, the 
comparison with the binarization threshold Th = 128 shows 
that the output data after binarization is 1 
corresponding to 255 out of 256 tones. Thus, an error of 
25 develops with respect to 230 of the input multivalued 
data D. The error 25 with respect to the input 
multivalued data D of 230 is determined as a binarization 
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error and distributed to the error memory 103 of 
unprocessed pixels by the weighted error calculator 105 
using an error matrix and thus reflected in the 
subsequent pixel binarization . 
5 The error matrix used in the conventional error 

spreading method is shown in Fig. 6. 

In Fig. 6, the pixel indicated by * is the 
existing intended pixel to be binarized. 

The error generated in binarizing this intended 
10 pixel is distributed to the unprocessed the next pixels 
with the weighting coefficients (7, 1, 5, 3) shown in 
Fig. 6. In binarizing the intended pixel indicated by *, 
the error distribution value stored is read from the 
error memory 103, and the next input value read from the 
15 image memory 100 is corrected using this error 
distribution value. 

As described above, according to the error 
spreading method, the binarization error for a given 
pixel is distributed to the pixel data to be subsequently 
20 binarized thereby to minimize the error between the image 
data after binarization data and the original multivalued 

image data. 

The image binarized by the error spreading 
method poses the problem of the reproducibility of the 
25 edge portion of the binarized image due to the fact that 
the error is distributed to the surrounding pixels. In 
other words, since the information of the surrounding 
pixels is partly added to the intended pixel, the 



reproducibility of the edge portion of the image is 

deteriorated . 

The conventional approach to this problem is a 
method of improving the edge retention by emphasizing the 
edge portion of the original multivalued data through a 
high-pass filter or the like. 

This method, however, gives rise to a new 
problem of the image quality deterioration with the whole 
image affected by the filtering, and therefore fails to 
) solve the problem in the true sense of the words. 

SUMMARY OF THE INVENTION 

The object of the present invention is to 
provide an image processing method capable of improving 
the edge reproducibility of a binary image after error 
5 spreading . 

In order to achieve this object, according to 
one aspect of the invention, there is provided an image 
processing method for generating a binary image by 
binarizing the pixel of the multivalued tone, comprising 
20 the steps of determining an intended pixel, determining 
pixels adjacent to the intended pixel, determining the 
density difference between the intended pixel and the 
adjacent pixels, and setting a threshold value for the 
binarization of the intended pixel thereby to binarize 
25 the intended pixel according to the density difference. 

In the case where the density difference (edge 
intensity) is large between the intended pixel and the 
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adjacent pixels , the binarization threshold is set to a 
low value to increase the probability of dot generation, 
and otherwise the binarization threshold is set to a high 
value to decrease the probability of dot generation. 
5 Thus, the edge reproducibility of the binary image after 
the error spreading process can be improved. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a circuit for 
executing an image processing method according to an 
10 embodiment of the invention. 

Fig. 2 is a diagram for explaining the pixels 
detected as an edge portion in an image processing method 
according to an embodiment of the invention. 

Figs. 3A, 3B, 3C are diagrams for explaining 
15 the setting of a threshold value for the binarization 
process in an image processing method according to an 
embodiment of the invention. 

Fig. 4 is a flowchart showing the processing 
steps in an image processing method according to an 
20 embodiment of the invention. 

Fig. 5 is a block diagram showing a circuit for 
executing the conventional error spreading method. 

Fig. 6 is a diagram for explaining an error 
matrix used in the conventional error spreading method. 

25 DESCRIPTION OF THE EMBODIMENTS 

An embodiment of the present invention will be 
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explained below with reference to the accompanying 
drawings . 

As shown in Fig. 1, the multivalued data D of 
the intended pixel to be binarized is read from an image 
5 memory 100, and subjected to 7 correction into the 
multivalued data corresponding to the printing 
characteristic of an output device such as a printer with 
reference to the correction data stored in a T 
correction ROM 101. The 7 -corrected multivalued data is 
G 10 subjected to edge detection by an adjacent edge detector 

W 108 for detecting the edge portion adjacent to the 

C : intended pixel, after which a threshold level is 

fj determined by a threshold determining unit 109 of an 

error spread processing unit 207. Also, the error data 
15 in the intended pixel is added in an adder 102. 
S The data on the intended pixel with the error 

5 data added thereto is compared with the threshold value 

determined by the threshold determining unit 109 in a 
comparator 104 thereby to output a predetermined binary 
20 signal. From this output result, the binarization error 
is calculated by a subtractor 106. 

This binarization error is stored in an error 
memory 103 for distribution to the data of the pixels 
subsequently processed according to a predetermined error 
25 matrix Mxy, added to the multivalued data of the next 
pixel in the adder 102, thereby transmitting the error 
data. 

The adjacent edge detector 108 is for detecting 
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whether the intended pixel being binarized constitutes an 
edge portion or not, and outputs the information as to 
whether the intended pixel constitutes an edge portion or 
not based on the multivalued data in the intended pixel 
and the left and right adjacent pixels. The process for 
detecting an edge portion will be described later. 

Also, in the case where the intended pixel is 
detected as an edge portion by the adjacent edge detector 
108, the threshold determining unit 109 sets a 
binarization threshold in accordance with the edge 
intensity in order to improve the edge reproducibility of 
the intended pixel. 

Now, the detection and retention of the edge 
will be explained with reference to Fig. 2. 

In Fig. 2, the image of the multivalued data to 
be binarized is shown. This multivalued data is 
represented by 256 tones (0 to 255) of data. In Fig. 2, 
the density of the intended pixel 120 and the adjacent 
pixel 121 is assumed to be 0, and the density of the 
adjacent pixel 122 is assumed to be 128. 

In this case, the pixel with the right and left 
adjacent pixels to be detected as an edge portion is the 
intended pixel 120. In the image of this pixel after 
binarization, no dot is generated and the adjacent pixel 
122 is a pixel that is to retain the edge portion. Also, 
the adjacent pixels 121, 122 are adjacent to the left and 
right sides of the intended pixel 120. In order to 
calculate the density difference between the left and 



right pixels of the intended pixel 120, the density is 
referenced at the time of edge detection. 

Now, assuming that the intended pixel is 120, 
an explanation will be given of the detection as to 
whether there is any edge portion adjacent to this 
intended pixel. Assume that the density data of the 
intended pixel 120 is Dl , the density data of the 
adjacent pixel 121 is D2, the density data of the 
adjacent pixel 122 is D3, and the density difference of 
the intended pixel 120 with the pixels 121 and 122 
adjacent to the left and right sides thereof are DL and 
DR, respectively. The density difference of the intended 
pixel 120 with the left adjacent pixel 121 and the right 
adjacent pixel 122 are given as DL = |D1 - D2 | and DR = 
|D1 - D3 | , respectively. 

In the case where this value exceeds a 
predetermined value S, the intended pixel 120 is detected 
as an edge portion. In other words, in the case where 
the relation DL > S or DR > S holds, the particular 
intended pixel is determined as an edge portion. 

Although the left and right adjacent pixels of 
the intended pixel are assumed to be adjacent pixels in 
this embodiment , the density of the upper and lower 
adjacent pixels or all the adjacent pixels including the 
left and right adjacent pixels or the surrounding pixels 
can be referenced to improve the edge detection accuracy 
and perform the control operation in accordance with the 
edge position, thus further improving the edge 



reproducibility . 

Now, an explanation will be given of the 
operation of controlling the dot generation upon 
detection of left and right adjacent edges of the 
intended pixel. 

With the pixel of which the left or right 
adjacent edge has been detected, the edge retaining 
process is executed by controlling the dot generation in 
accordance with the density difference between the 
intended pixel and the left and right adjacent pixels. 
In this way, the reproducibility of the left and right 
adjacent edges can be improved. In controlling the dot 
generation, the rate of dot generation can be reduced by 
changing the threshold for binarization of the pixel of 
which left and right adjacent edges have been detected. 

This process will be explained with reference 
to Figs. 3A to 3C showing the relation of the dot on/off 
with respect to the setting of the density and the 
threshold of the image data for the error spread 
operation. 

Generally, the binarization threshold in the 
conventional error spreading method, as shown in Fig. 3A, 
is set and fixed at about 128 intermediate of the input 
density of 256 tones. According to this embodiment, on 
the other hand, as shown in Fig. 3B, the dot off area is 
widened by increasing the binarization threshold for the 
pixel of which left and right adjacent edges have been 
detected. In this way, the dot generation is suppressed 
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in the particular pixels so that the dot generation is 
reduced in the pixels adjacent to the edge thereof, 
thereby improving the reproducibility of the edge 
portion. 

Also, as shown in Fig. 3C, the dot on area is 
widened by reducing the binarization threshold for the 
pixel of which right and left adjacent edges have been 
detected, so that the dot generation is facilitated in 
this pixel. 

In this way, a more faithful edge reproduction 
is made possible by changing the threshold value in 
accordance with the edge intensity with the left and 
right adjacent pixels of an intended pixel detected as an 
edge portion. 

Specifically, let D be the difference in 
density between the intended pixel detected as an edge 
portion and the left and right adjacent pixels, N be a 
constant for setting the variation of the threshold 
value, and Th be a binarization threshold for the 
intended pixel. Then, the threshold value is set as Th = 
128 - D/N. 

As a result, for a pixel having a large edge 
intensity, the binarization threshold Th is set to a low 
value so that the probability of dot generation in the 
5 intended pixel increases. For a pixel having a small 
edge intensity, on the other hand, the binarization 
threshold Th is set to a high value and therefore the 
probability of dot generation is decreased, with the 
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result that dots are not easily generated. For the 
pixels not determined as an edge portion, the 
binarization process is executed with a fixed threshold 
Th of 128. 

5 According to this embodiment, the threshold Th 

is controlled by the aforementioned formula. A more 
faithful edge reproduction is possible, however, by 
controlling the threshold Th using a formula having a 
nonlinear characteristic without resorting to the formula 
G 10 having the aforementioned linear characteristic. 

VI Without using a calculation formula, a more 

O detailed setting of a threshold is made possible by 

III preparing a table for holding threshold values 

l5 " corresponding to the density difference D between the 

iff 15 intended pixel and the adjacent pixels, and setting a 

|SJ threshold value by reference to this table. 

;i!f This binarization process will be explained 

with reference to the flowchart of Fig. 4. 

In Fig. 4, first, a line of multivalued data of 
20 the image to be binarized is stored in the image memory 
100 (step s200), and then the error data distributed to 
the pixels on this line are stored in the error memory 
103 (step s210). The density data Dl of the pixel to be 
binarized from a line of the data is read and a weighted 
25 error in this pixel is added thereby to acquire the 

intended pixel data. At the same time, this pixel data 
is 7 -corrected based on the correction data in the 7- 
correction ROM 101 (step s220). 
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Then, in the adjacent edge detector 108 , the 
density data D2, D3 of the left and right adjacent pixels 
of the intended pixel are acquired from the image memory 
100 (step s230), thereby calculating the density 
5 difference DL = | Dl - D2 j and DR = jDl - D3 | between the 
density data Dl of the intended pixel and the density 
data D2 and D3 of the left and right pixels (step s240), 
respectively . 

The density differences DL, DR thus obtained 

10 are compared with a setting S (step s250), and in the 

case where the density difference DL or DR is larger than 
the setting S, the threshold determining unit 109 detects 
this pixel as the one adjacent to the edge, and sets the 
threshold Th using the formula Th = 128 - D/N in 

15 accordance with the edge intensity (step s270). In the 
case where both the density differences DL and DR are 
smaller than the setting S, on the other hand, this pixel 
is determined as the one not adjacent to an edge and the 
threshold 128 is maintained (step s260). 

20 After setting a threshold in this way, this 

intended pixel is binarized by error spreading (step 
s280), and thus the process for this pixel is terminated. 

It is then determined whether the 
aforementioned process has been completed for all the 

25 pixels on the current line (step s290), and unless the 
process is not complete for all the pixels of the line, 
the process proceeds to the next pixel (step s310) for 
executing steps s220 to s280. In the case where the 
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process for all the pixels on the line is complete, on 
the other hand, it is determined whether the process is 
complete for all the lines (step s300). Unless the 
process for all the lines is complete, the operation 
proceeds to the next line (step s320), and the same 
operation is repeated until the process for all the lines 
is completed* 

As described above, according to this 
embodiment, the density difference between the intended 
pixel and adjacent pixels is determined, and in the case 
where the density difference is larger than a 
predetermined setting, the intended pixel is determined 
as an edge portion. In such a case, the threshold for 
binarizing the intended pixel constituting an edge 
portion is set to a value which is smaller, the larger 
the edge intensity with the adjacent pixels. As a result 
of this binarization, in the case where the edge 
intensity with the pixel adjacent to the intended pixel 
is large, the binarization threshold is set to a low 
value to increase the probability of dot generation. 
Otherwise, the binarization threshold is set to a high 
value for a lower probability of dot generation. As a 
result, the edge reproducibility of the binary image 
after the error spreading can be improved. 

The thresholds used in this embodiment are only 
an example of numerical values that can be employed, and 
the invention is not limited to these numerical values. 

It will thus be understood from the foregoing 
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description that according to this invention, in the case 
where the edge intensity of an intended pixel with 
adjacent pixels is large, the binarization threshold is 
set to a low value for an increased probability of dot 
generation, and otherwise the binarization threshold is 
set to a high value for a reduced probability of dot 
generation. Thus, the edge reproducibility of a binary 
image after the error spreading process can be improved. 
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CLAIMS : 

An image processing method for generating a 
binary image by binarizing the pixels of multivalued 
tones, comprising the steps of: 

determining an intended pixel; 
determining at least a pixel adjacent to said 
intended pixels- 
determining the density difference between said 
intended pixel and said adjacent pixel; and 

setting a threshold value for binarization of 
said intended pixel in accordance with said density 
difference and binarizing said intended pixel . 

2 - An image processing method for generating a 
binary image by binarizing the pixels of multivalued 
tones, comprising the steps of: 

determining an intended pixels- 
determining at least a pixel adjacent to said 

intended pixels- 
determining the density difference between said 

intended pixel and said adjacent pixel; and 

determining said intended pixel as an edge 

portion in the case where said density difference is 

larger than a predetermined setting; and 

setting a binarization threshold value for said 

intended pixel determined as an edge portion in 

accordance with the edge intensity and binarizing said 

intended pixel. 

3 - An image processing method for generating a 



binary image by binarizing the pixels of multivalued 
tones, comprising the steps of: 

determining an intended pixel; 

determining at least a pixel adjacent to said 
intended pixel; 

determining the density difference between said 
intended pixel and said adjacent pixel; and 

determining said intended pixel as an edge 
portion in the case where said density difference is 
larger than a predetermined setting; and 

setting the binarization threshold for said 
intended pixel determined as an edge portion to a value 
lower, the larger the edge intensity with the adjacent 
pixel and higher, the smaller the edge intensity with the 
adjacent pixel. 

4 . An image processing apparatus for generating a 

binary image by binarizing pixels of multivalued tones , 
comprising: 

means for determining an intended pixel; 

means for determining at least a pixel adjacent 
to said intended pixel; 

means for determining the density difference 
between said intended pixel and said adjacent pixel; and 

means for setting the binarization threshold of 
said intended pixel in accordance with said density 
difference and binarizing said intended pixel. 
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ABSTRACT OF THE DISCLOSURE 

An image processing method and an image 
processing apparatus for generating a binary image by 
binarizing the pixels of multivalued tones are disclosed. 
An intended pixel, at least a pixel adjacent to the 
intended pixel and the density difference between the 
intended pixel and the adjacent pixel are determined. In 
the case where the density difference is larger than a 
predetermined setting, the intended pixel is determined 
as an edge portion. The binarization threshold for the 
intended pixel constituting an edge portion is set lower, 
the larger the edge intensity with the adjacent pixel. 
Thus, the edge reproducibility of the binary image after 
error spreading is improved. 
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I hereby claim the benefit under Title 35, United States Code, 120 of any United States application(s) or PCT 
international application(s) designating the United States of America that is/are listed below and, insofar as the 
subject matter of each of the claims of this application is not disclosed in that/those prior apphcation(s) m the 
manner provided by the first paragraph of Title 35, United States Code §1 12, I acknowledge the duty to disclose 
to the United States Patent and Trademark Office all information known to me to be material to patentability as 
defined in Title 37, Code of Federal Regulations, §1.56 which became available between filing date of the prior 
application and the national or PCT international filing date of this application. 



(U.S. Application Number) 



(U.S. Filing Date) 



Status (patented, pending, abandoned) 



I hereby appoint the following attorneys of the firm of STEVENS, DAVIS, MILLER & MOSHER, L.L.P. as my 
attorneys of record with full power of substitution and revocation to prosecute this application and to transact all business 
in the Patent and Trademark Office: . . 

James E. Ledbetter, Reg. No. 28732; Thomas P. Pavelko, Reg. No. 31689; and Anthony P. Venturino, Reg. No. 

31674 ALL CORRESPONDENCE IN CONNECTION WITH THIS APPLICATION SHOULD BE SENT TO 
STEVENS, DAVIS, MILLER & MOSHER, L.L.P., 1615 L Street, N.W., Suite 850, Washington, D.C. 20036; 
Mailing Address: P.O. Box 34387, Washington, D.C. 20043, TELEPHONE (202) 408-5100 
FACSIMILE (202) 408-5200 or (202) 408-5088. 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge that willful 
false statements and the like so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the 
United States Code, and that such willful statements may jeopardize the validity of the application or any patent issuing 

thereon. _ „ _ . A „ 

See page 2 for signature lines . . 

K & & See instructions for completing this form 



STEVENS, DAVIS, MILLER Sc MOSHER, L.L.P. 
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*14a Typewritten Full Name 
of Sole or First Inventor 



*15a Inventor's Signature 



PAGE 2 OF U.S.A. DECLARATION FORM 

H i royuki MQRIMATSU 



Given Name 



Family Name 



*16a Date of Signature 



C^" May 9, 2000 



17a Residence 



18a Citizenship 



Month 

Kurume-shi, Japan 



Day 



Year 



City 
Japan 



State or Province 



Country 



19a Post Office Address 

(Insert complete mailing 
address, including country) 

0 s Mb Typewritten Full Name 
ifi of 2nd Inventor (if any) 



284-2 , Minamimachi, Kurume-shi , Japan, 



Given Name 



Middle Name 



Family Name 



in?! 15b Inventor's Signature 



^*16b Date of Signature 



Month 



Day 



Year 



17b Residence 



'2ft 8b Citizenship 



City 



19b Post Office Address 

(Insert complete mailing 
address, including country) 



State or Province 



Country 



*l4c Typewritten Full Name 
of 3rd Inventor (if any) 



*15c Inventor's Signature 



Given Name 



Middle Name 



Family Name 



*16c Date of Signature 



Month 



Day 



Year 



17c Residence 



18c Citizenship 



City 



19c Post Office Address 

(Insert complete mailing 



address, including country) 



State or Province 



Country 



*Note to Inventor: Please sign name on line 15 exactly as it appears in line 14 and insert the actual date of signing on line 16. If there are more than three inventors, 
please add a copy of this page for identification and signatures for the additional inventors. 



STEVENS. DAVIS, MILLER & MOSHER, LX.P. 



